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Abstract: We investigate the behavior of the Gibbs-Shannon entropy of the 
stationary nonequilibrium measure describing a one-dimensional lattice gas, 
of L sites, with symmetric exclusion dynamics and in contact with particle 
reservoirs at different densities. In the hydrodynamic scaling limit, L — > 

00, the leading order (O(L)) behavior of this entropy has been shown by 
Bahadoran to be that of a product measure corresponding to strict local 
equilibrium; we compute the first correction, which is 0(1). The computation 
uses a formal expansion of the entropy in terms of truncated correlation 
functions; for this system the k th such correlation is shown to be 0(L~ k+1 ). 
This entropy correction depends only on the scaled truncated pair correlation, 
which describes the covariance of the density field. It coincides, in the large 
L limit, with the corresponding correction obtained from a Gaussian measure 
with the same covariance. 

1 Introduction 

The properties of nonequilibrium stationary states (NESS) of open systems, 

1. e., ones in contact with infinite reservoirs at different chemical potentials 
and/or temperatures, is a subject of great interest [1] [15]. The simplest 
nontrivial example of such a system is the one-dimensional simple symmetric 
exclusion processes (SSEP) on the finite lattice A L = {1, 2, . . . , L}, with 
particle reservoirs coupled to sites 1 and L\ we take these reservoirs to have 
densities p a and p b , respectively, with p a > p b . The 2 L possible configurations 
of the system are described by the L-tuple r L = (n, tl), with 73 = 1 if site 
i is occupied and r, = if the site is empty. The stationary measure Pl{Zl) 
of the system is explicitly known in terms of products of noncommuting 
matrices jH HU] . Using this representation it is possible to obtain considerable 
information about the truncated correlation functions at k distinct sites, 
( r n ' ' ' r ifc)sz/ m particular these are 0(L~ k+1 ), in the sense that 

lim L k - 1 (T lxiLr --T lxkL1 )l L =F k (x 1} ...,x k ), (1.1) 



1 Laboratoire de Physique Statistique, Ecole Normale Superieure, 24 rue Lhomond, 
75005 Paris, France; email derrida@lps.ens.fr. 

2 Department of Mathematics, Rutgers University, New Brunswick, NJ 08903; email 
lebowitz@math.rutgers.edu, speer@math.rutgers.edu. 

3 Also Department of Physics, Rutgers. 



1 



for certain continuous functions Fi(xi), F 2 (xi,x 2 ), etc; here |_£J is the great- 
est integer not exceeding £. These correlations are thus very long range and 
contribute, despite their vanishing pointwise as L — > oo, to the fluctuations 
(and larger deviations) about the typical density profile p(x) = Fi(x) = 
limi-^oo^a-ij) in the hydrodynamic scaling limit, L — > oo, i/L — > x G [0, 1], 
where z = 1, . . . , L labels the lattice sites [TU] . 

In this hydrodynamic limit the typical density profile p{x) is the sta- 
tionary solution of the macroscopic hydrodynamic equation with boundary 
conditions p(0) = p a , p(l) = p b - For the SSEP this is the simple diffusion 
equation and so 

p(x) = p a (l - x) + p b x. (1.2) 

The fluctuations about the typical profile p(x) are given by a Gaussian field 
whose covariance is determined by the truncated pair correlation function 
[31 HO]. The result agrees with that obtained from fluctuating hydrodynamics 

In this paper we study the relation between the functions F& and the 
L — > oo limit of the Gibbs-Shannon entropy of the stationary measure pi , 
defined for any measure pl by 

S{p L ) = ~ ^2 Vl(t l ) log h l (t l ). (1.3) 

In this limit S(pi) is 0(£) and only i<\ is relevant to leading order (this is a 
result of Bahadoran [T7]) and our goal here is to show that only F\ and F2 
are relevant for the first correction, which is 0(1). 

Our motivation for studying S(pl) is its potential connection with devia- 
tions from the typical profile p(x) [18J. The expectation of such a connection 
comes from our experience with equilibrium systems, for which the probabil- 
ity of such deviations is determined by the induced change in the entropy. 

In fact, the open SSEP with NESS measure pi is, in the hydrodynamic 
scaling limit, very closely related to such a (local) equilibrium system. To 
make this more precise, let us define the product measure with expected 
density at site i by 

L 

v ( r\z L ) = Hin l T l + (l-n t )(l-T t )}, (1.4) 

8=1 

and for any macroscopic density profile p(x) write (with some abuse of no- 
tation) uf' = with rij = p(i/(L + 1)) (the specific definition of arises 
from the convention that the system has total length L+l, with the boundary 
reservoirs located on sites i = and i — L + 1). Then the restriction of the 
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NESS measure pL to the variables t* for i lying in an interval [\_xL\ , [xL\ +m], 
where m is independent of L, is indistinguishable, for L — ► oo, from the corre- 
sponding restriction of the local equilibrium product measure vj? (see (11.21) ). 

For this product measure vf^ the probability of observing a density profile 
p(x) is given, for large L, by 

Prob({p(x)}|z/^) ~ e-^^*)}), (1.5) 

where the free energy or large deviation functional (LDF) jF cq can be written 

as 

-•Feq({p(aO}) = y {[s(p(x)) + A(p(z))p(x)] 

-[s(p(a;)) + A(p(x))p(x)]}d a ;. (1.6) 

Here s(r) = — (r logr + (1 — r) log(l — r)) is the entropy per unit length (or 
site) of the product measure with constant density r, and 

A W = -|(r) = log( r ^ : ) (1.7) 

is the chemical potential which yields this density. The connection between 
the LDF J^q and entropy given in (11. 6B extends to more general (non product) 
local equilibrium measures [T9~l [20]. 

Given this connection between entropy and large deviations in equilibrium 
systems, it is natural to ask whether there exists a similar relation between 
S(P,l) and the large deviation functional in the NESS of the SSEP, for which 
Prob({p(x)}\p,L) is qualitatively different from ( 11.5jl [HI [TJ [9l [10] . Using results 
of Kosygina [21], Bahadoran showed, for a large class of systems including 
the open SSEP, that 

lim jS(fl L ) = lim \s{uf). (1.8) 

L— >oo ±j L—>oo ±j 

In other words, the Gibbs-Shannon entropy is, to leading order, exactly the 
same as that of the product measure with density p(x), i.e., vf\ It thus does 
not reflect at all the very different nature of the large deviation functional 
for the NESS in comparison with that of equilibrium systems. 

Information about the probabilities of untypical configurations in the 
NESS of the SSEP is encoded in the truncated correlation functions, or 
equivalently in the Fk's of ( 11. lft . These also contribute to the entropy S(pZl) 
beyond the leading order. This is what we investigate in the present note. 
We find that the difference 

R L = S(fl L )-S(uf) (1.9) 
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approaches a constant value R as L — > oo; Bahadoran's theorem only says 
that it grows slower than L. Furthermore R depends only on the pair cor- 
relation function F2, indicating that only configurations which contribute to 
the Gaussian fluctuations about p(x) contribute to the entropy at this order. 
This permits us to obtain an explicit expression for R as the L — > 00 limit 
of Rl, the corresponding difference in entropies for a Gaussian measure on 
variables G R, % = 1, L, having the same covariance matrix as Jll- We 
present analytic arguments in favor of this expression, and also check it nu- 
merically via exact computations on systems of different sizes. It appears in 
fact that our results extend to more general systems having long range trun- 
cated correlation functions of the form (11.11) . as we discuss in section [2TTT . 

The outline of the rest of this paper is as follows. In section [5] we describe 
the SSEP and the corresponding Gaussian model, and in section 12.11 the 
possible extension to other models, in particular, the weakly asymmetric ex- 
clusion process (WASEP). In section [3] we report on numerical computations 
of the entropy difference Rl — Rl for different system sizes and densities, 
in both the SSEP and the WASEP. In section H] we compute rigorously the 
L — > 00 limit of Rl for the Gaussian model. In section [5] we establish a 
relation between an arbitrary measure /x(r A ), where r A = (rj) i6 A with A any 
finite set of points, and the truncated correlations dligA' t «)ma ^ or ^' c ^' 
we develop from this an expression for the entropy in terms of the truncated 
correlations. We use this in section [U]to argue that the difference lim^oo R L 
exists and has value R = lim^oo R L . 



2 The models and the results 

We begin with a full description of the SSEP. In this model each particle 
independently attempts to jump to its right neighboring site, and to its left 
neighboring site, in each case at rate 1 (so that there is no preferred direction). 
It succeeds if the target site is empty; otherwise nothing happens. A particle 
is added to site 1, when the site is empty, at rate a, and removed, when the 
site is occupied, at rate 7; similarly particles are added to site L at rate 5 
and removed at rate j3. This corresponds [10J to the system being in contact 
with infinite left and right reservoirs having respective densities 

a 5 
Pa = — ; — , Pb = 75—7 • 2.1 

7 + a (3 + b 

We also introduce the parameters 

1 ,1 , s 

a = , b=- -. 2.2 

7+« P+5 v ' 
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We give in Appendix A a proof of the scaling form (11.11) for this model. 
The first three truncated correlations are, for i < j < I, 

i v pa{L + b-i) +p b {i + a- 1) 

(Tj) - = L + a + b-1 ' (2 ' 3) 

~ (L + a + 6-l)2(L + a + 6-2)' 1 J 

T n (p a - p fe ) 3 (2 + a - 1)(L + 1 + b - a - 2j)(L + b - I) 

WTihL - ( L + a + & _3)( L + a + & _2)(L + a + 6- l) 3 ' l } 

Thus (II. ip holds for k = 1,2, 3, where for x < y < z, 

Fi(x) = p a (l- x) + p b x, (2.6) 
F 2 (x,y) = -( Pa -p b ) 2 x(l-y), (2.7) 
F 3 (x,y,z) = -2(p a -p b ) 3 x(l-2y)(l-z). (2.8) 

We remark that if a = b = 1 then (Tj)^ = p[ij{L + 1)) and the entropy 
difference Rl of (11.91) must be negative, since maximizes the entropy 
S(fjL) among all measures \i satisfying (r^ = p(i/(L + 1)). Because our 
expression (14.161) for lim^oo Rl is independent of a and b, this limit must 
be negative or zero. 

In the remainder of the paper we argue that, in the SSEP, the next order 
correction to the result of Bahadoran will be equal to the correction for a 
Gaussian system with the same covariance. Specifically, let vl and (xl be 
Gaussian measures on L variables with mean zero and respective covariance 
matrices Jl and K L given by 

(^^(^(l-iny, (Jl)v=0, i^j; (2.9) 

(K L ) u = {T i ) llll (l-(T i )^), {K L ) U = (r^, i^j. (2.10) 

We note from (I2.3P that (rj)^ and 1 — (t^)^ do not vanish. The entropies 
of these Gaussian measures are given by 

S(9 L ) = ^(l + log2vr) + ^logdetJ L , (2.11) 

S{pl L ) = ^(l + log2vr) + ilogdetif i , (2.12) 



so that 



R L = S(fi L ) - S{v L ) = ^log^^- (2.13) 



The L -y oo limit of f[2~T3l) . 



R = lim R L = lim ~ log (2.14) 

L^oo L^oo 2 det Jr, 
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exists; see section HJ Further, we claim that this limit gives also the lowest 
order correction to the result fll.Sp of Bahadoran (see (11.91) ) : 

lim R L = lim [S{p L ) - S{vf)\ = R. (2.15) 

L^oo L—*oo 

2.1 Other models 

It is natural to ask to what extent these results hold for other lattice gas 
models. As will become clear in section [6j the key element in our analysis for 
the SSEP is the scaling behavior f 1 1.1ft of the truncated correlation functions. 
(We also use some technical facts about the way the limit in f 1 1.1ft is achieved 
and the size of the limiting functions F^.) We expect ( 12.15ft to hold for mod- 
els having this same scaling behavior and satisfying an additional condition 
discussed in Remark 4.1. 

Unfortunately, less is known about the correlation functions for other 
lattice gas models than for the SSEP; in particular, we know of no other 
model of an open NESS for which ( j 1.1 ft has been established with nonzero F^, 
k > 2 (for zero range processes the NESS is a product measure, i.e., Fk = 
for k > 2). We expect, however, that this scaling will hold in the weakly 
asymmetric simple exclusion process (WASEP); see |22j, where expressions 
corresponding to (12.61) and (12. 7\i are given for this model. In the WASEP 
the boundary dynamics are those of the SSEP, but the bulk dynamics are 
modified so that a particle attempts to hop to its right at rate 1 and to 
its left at rate exp(— A/L); A is a parameter which interpolates between the 
symmetric process (A = 0) and the totally asymmetric process (A = ±oo). 
The typical profile p(x) is the solution of the viscous Burgers equation. We 
include numerical results for the WASEP in the next section. 

The truncated correlation functions are also expected to satisfy ( 11.11) in 
the KMP model pp. This is an open system in which the variable G M + 
at site i, i = 1, . . . , L, represents an energy at that site, and p a and p b are 
replaced by temperatures T a and T b . For this system [TJ, 

F* MP (x) = lim (£ LxLJ > = T a (l -x)+ T b x, (2.16) 

while for x < y [23J, 

F 2 KMP (x,y) = lim L{£ lxLi Z lyLi) ) = (T a ~T b fx^-y)- (2-17) 

One can also imagine that for more general diffusive systems, such as 
those described by the macroscopic fluctuation theory [TJ E] , the long range 
part of the truncated correlation functions scales as in (1.1) 
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3 Numerical results 



We have investigated ( 12.151) numerically for the SSEP, at several different 
values of the boundary densities p a , Pb, and for the WASEP, at p a = 1, 
Pb = 0, for several different values of A. For all computations we have taken 
a = b = 1 (see (12. 2p ). We were able to consider systems up to size L = 25. 
In each case we computed the measure pi explicitly and from this S(pl), 
S(u^), S(pi), and S(9 L ), and thus, from (II. 9p and (I2.13p . Rl and Rl- For 
the SSEP we could also compute the limiting value R, defined in (12. 141) . to 
a high degree of accuracy, using (12. 4ft . 

Figures 1 and 2 present our results for the SSEP. In order to show re- 
sults for several parameter values on the same figure, we plot the normalized 
difference 

?±Z3L (3.1) 
R v ; 

as a function of 1/L. The table within each figure gives the values of p a and 

Pb for each curve, as well as the corresponding value of R. Confirmation of 

(I2.15P corresponds in each case to lim 1 / i ^ (i? i — R L )/R = 0. This certainly 

appears to hold, but the maximum system size we have been able to achieve 

is perhaps too small for the evidence to be completely convincing. 

Figure 3 gives similar plots for the WASEP, at different values of A, with 

p a — 1, pi, — 0. Here we have no closed form for the two-point correlation 

function, so that an accurate computation of R is more difficult than for 

the SSEP; we therefore plot the unnormalized difference Rl — Rl against 

1/L. The behavior for small L is quite irregular, particularly for negative 

values of A, but the large- L behavior again provides some confirmation that 

lim 1 / L _ >0 (-R-L — Rl) = 0, i.e., that ( 12.151) holds for this model. 

4 The Gaussian limit 

In this section we evaluate the limit R of (12.141) . Let us write 

det(I + U L ), (4.1) 



det J j 
where 



det Kl , 4 
■■ det 



U L = Jl ip -\K L - J L ]Jt 1/2 , (4.2) 
so that (Ul)u = 0, i = 1, . . . , L, and 

(U L h = ^ T I < i j < L. (4.3) 

1 vWWHi 
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Pa Pb R 

1 .0 0.8 -0.000997 

1 .0 0.6 -0.00493 

1.0 0.4 -0.0144 

1.0 0.2 -0.0365 

1.0 0.0 -0.108 




0.35 



1 / L 



Figure 1: Differences of corrections to entropies in the SSEP and Gaussian 
models for p a = 1 and several choices of pi,. The data are consistent with the 
vanishing of Rl — Rl as L — > oo. 



In order to pass to a continuum limit it is convenient to relate U to the 
integral operator Hl on L 2 ([0, 1]) with kernel 

h L (x, y) = L{U L )ij, ioi l -^<x< 1 -, J -j± <V<J, (4-4) 

that is, (H L (f))(x) = h L (x,y)<fi(y) dy for <p e L 2 ([0, 1]). Since H L has rank 
(at most) L, all but L of the eigenvalues of / + Hi are equal to 1, so that 
the determinant det(J + Hl) is certainly well defined. Then 

det(/ + C^)=det(/ + ^ L ), (4.5) 

since if we define 

^ L .( x ) = /v^» if (< - 1)/L < x < </L, (46) 
[ 0, otherwise, 

then the ipL,i for i = 1, . . . ,L form an orthonormal set in L 2 ([0, 1]) which 
spans the range of Hl and satisfies HiipL^ = Ylj(Ui<)jii>L,j- 
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Now f 1 1.11) implies that for x ^ y, Hindoo h L (x, y) = h(x, y), where 

h(x v) = F2(X,y) (4 7) 

y/F 1 (x)(l-F 1 (x))F 1 (y)(l-F 1 (y))' 

Let H be the integral operator on L 2 ([0, 1]) with kernel h. It can be shown 
that H is of trace class (we define this precisely below), so that det(/ + if) is 
well defined [21]. However, it is not true that lfm^oo det(J + Hl) = det(/ + 
H); essentially, this is because the diagonal elements of Hl are zero rather 
than being given by the obvious extension of (14.3)) , and as a consequence Hl 
does not converge to H in trace norm. To evaluate the limit correctly it is 
helpful to introduce the regularized determinant [21]; one needs then only 
convergence of Hl to H in a weaker sense. 

We now discuss the general theory of the regularized determinant in the 
(relatively simple) context in which we will use it. Let A be a compact 
integral operator on L 2 ([0, 1]) with symmetric kernel a(x,y) = a(y,x), so 
that (Acf))(x) = L a(x,y)(j)(y) dy; A is self-adjoint and hence diagonalizable: 
A<j) n = X n (f) n for some orthonormal basis <p n . A is of trace class if ||A||i = 
< 00 an d of Hilbert-Schmidt class if ||A|| 2 = J2 n \ ^n\ 2 < oo; we also 

have 

-I 



\\A\\ 2 = / / \a(x,y)\ 2 dxdy. (4.8) 
Jo Jo 

If A is of trace class then both the trace Tr A = ^2 n X n and the Fredholm 
determinant det(J + A) = Jl(l + A n ) are well defined and satisfy logdet(J + 
A) = Trlog(J + A). If A is of Hilbert-Schmidt class then det(J + A) may 
not be defined but A = e~ A (I + A) — I is of trace class and the regularized 
determinant det 2 (i + A) is defined by 

det 2 (J + A) = det(/ + i). (4.9) 

We note several properties of det 2 which we will need below: (i) if A is of 
trace class then 

det 2 (I + A) =det(I + A)e~ TlA ; (4.10) 
(ii) if A is Hilbert-Schmidt and k > 2 then A k is of trace class, with 

TrA k = / dx 1 --- dx k h(x 1 ,x 2 )---h(x k ^ 1) x k )h(x k ,xi), (4.11) 
Jo Jo 

and Tr A k is continuous in the Hilbert-Schmidt norm, i.e., 

limTr^ = TrA fc if lim \\A n - A\\ 2 = 0; (4.12) 



n— >oo n— >oo 
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(iii) det 2 (J + A) is continuous in the Hilbert-Schmidt norm, i.e., 



lim det 2 (7 + A n ) = det 2 (J + A) if lim \\A n - A\\ 2 = 0; (4.13) 

n^oo n— *oo 

and (iv) if the operator norm of A satisfies \\A\\ < 1 then 

logdet 2 (/ + A) = '- TrA n . (4.14) 

n=2 

In order to apply these ideas we note that it follows from (12. 3ft . (12.41) . 
(12.61) . and (12.71) that the kernel h(x,y) is square integrable and that 

lim \\H L - H\\ 2 = lim ( [ \h L (x, y) - h(x, y)\ 2 dxdy = 0. (4.15) 

L^oo L ^°°Jo Jo 

Now from fflOUl) and the fact that Tr H L = it follows that det(J + H L ) = 
det 2 (I + H L ), and hence from P~T]h (Q5I> . and (Q5jl . Hm^^det (/+[//) = 
det 2 (J + F). Thus from (gUD and (Oil . 

i?= lim[5(/i L )-5(z> L )] = ^logdet 2 (/ + J ff). (4.16) 

Remark 4.1: (a) It follows from ( 12.61) and (12. 7ft that \h(x,y\ < 1, with 
strict equality possible only for x = y and p a — 1 — pb — 1; this implies that 
the operator norm of if is less than one, so that from (14. 14j) we have the 
expansion 



r = J2 — — TrHn - ( 4 - 17 ) 

n=2 



2n 



The convergence of the expansion (I4.17P is the additional condition for the 
validity of (I2.15P referred to in section 12. 1[ 

(b) The operators — may be shown to be positive semi-definite, and hence 
—H is also; from / (— h(x, x)) dx < oo and the continuity of h(x,y) it then 
follows that H is of trace class [21]. Thus in fact det 2 (7 + H) is given by 

dun}. 



5 Truncated correlations and entropy 

In this section we derive an expression for the probability of a configuration, 
and an expansion for the entropy, in terms of truncated correlation functions. 
The results hold in a more general setting than the specific models we are 
considering here. Thus let A be any finite set and fi\ be a measure on the 



11 



configurations r A on A: r A = (Tj)j e A, 7* = 0, 1. In particular, A might be a 
subset of a larger set, say A C Z d , and \x the restriction of some measure on 
the configurations on this larger set to the configurations on A. For any set 
A = . . . , ik} C A we will write \xa for the marginal of //a on configurations 
defined on A and va for the product measure on the configurations on A 
which has the same one-site probabilities as does fix' for a configuration 
Za = ( r u ? • • • > T i k ) witn T i = 0,l, and with t { = (t^, 

MZa) = II W - Uf~ n = II^ + t 1 - ^X 1 - *<)]■ (5-1) 

5.1 Probabilities and truncated correlations 

For the subset A — {ix, . . . , i k } C A we denote the truncated correlation 
function (r^ • • • Tj fe )^ A on the sites of A by t^; if A = {2} we usually write tj 
rather than in accord with ( 15. ip . Recall that is defined recursively 
by writing the (untruncated) correlation function on the sites of A as a sum, 
over all partitions of A into disjoint subsets, of the products of the truncated 
functions for the subsets: letting V(A) denote the set of all partitions of A 
into disjoint subsets we have 

neP(A) B£tt 

where ir labels a particular partition. 

For use in the next subsection it is convenient to rewrite the measure fi\ 
by factoring out the product measure u\: 

Ma(Ia) = MZa)(1 + za(ta)), (5.3) 

where 

Here V(A), AcA, denotes the set of nonempty families n = {Bi, . . . , B k ^} 
of pairwise disjoint subsets of A in which each set Bi contains at least two 
points, with C n = |J i Bi for n G V(A), and 

g i {r i )=tp[-(l-U)}-^ ) = i-^^T-Y ^ 

To verify this formula one multiplies both sides of (15.31) by some product 
T il ...r ik and sums over r A ; the result is just (5.2). 
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Remark 5.1: An alternate way of viewing (I5.3P is to introduce truncated 
measures fiA defined by a recursion analogous to that for the truncated cor- 
relation functions: 

Va{t a )= YI^b(t b ). (5.6) 

nGV(A) Bew 

Disentangling (I5.6p . on sees that fiA is a linear combination of measures on 
the configurations on A, but for \A\ > 1 with some negative coefficients; that 
is, (ia is a signed measure. There is a surprisingly simple relation between 
these truncated measures and the truncated correlation functions: we claim 
that 

= V{i}(n), (5.7) 

and if 151 > 2, 



i.e., £ib{.Zb) ls equal to either or — depending only on whether ^ igB (l — 
Tj) is even or odd. Equation (15.71) is an immediate consequence of the defini- 
tion (15.61) . Equation (15.81) may be verified by substituting (15.71) and (15.81) into 
the right hand side of (15.61) . multiplying the result by some product Yli&c r *> 
where C C A, and summing over all r^; the result is just (15.21) . If we now 
substitute (15.71) and CI5. 81) into (15.61) we obtain (15.31) . 

5.2 Expansion of the entropy 

In this subsection we obtain a series expansion for the entropy difference 
S(fiA) — S(u\). Other graphical expansions for the entropy have been ob- 
tained, for example in [261 [27] . From H 5 . 3 f) and the definition (11.31) we have 



S^Ma) = -^2Mz a )(1 + ^A(T A ))log[^ A (T A )(l + x a (t a ))} 

La 

= ~ Yl u ^Za) log MZa) + Xa(Za) log Mza) 



+ (l + x A (r A ))log(l + x A (r A ))]. (5.9) 

With the expansion 

00 (—\\ n 

(l + x)log(l + x) =x + J^-j x n , (5.10) 

' n(n — 1 

n=2 v ' 
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and the identities 

£ MZaW(t a ) = 0, Mza)xa(Za) log^ A (r A ) =0, (5. IT 



Ha 



which follow from (I5.3P and the equations (1)^ 
( T i)u A = Ui respectively, (I5.9P yields 

°° (-1 



1)„ A = 1 and (r;) 



A' A 



,n+l 



n=2 



n(n — 1) 



(5.12) 



This expansion requires that |xa(t a )| < 1 for all r A ; for the SSEP we have 
checked this condition numerically for L = 1, . . . , 23 at several values of p a , 
Pb- 

We next insert the definition (15.4ft of x A into ( 15.121) and expand x A (r A ) n : 



^a)-5K)=e^a)E^T) e n 

r A n=2 ^ ' 7ri,...7r B j=l 



n ^) n *s 



iecv 



(5.13) 

This expression can be reorganized as an (infinite) linear combination of 
monomials M in the variables is- The coefficient of the monomial M is 



n=2 ^ ' t a igA 



TOi(M) 



(5.14) 



where c n (M) is the number of n-tuples (tti, . . . , vr n ) such that M is given by 
the product YYj=i risgTr ^b, and m^M) is the number of factors t B in the 
monomial M such that z G B. 

We can carry out the sum over r A in (I5.14p . using (with irii = rrii(M)) 



n=0,l 



+ 



-1' 



(1 -u) m >-\ 



(5.15) 



Since hi(M) = 1 if m^M) = 0, (15131) and (I5TT4D yield 

SW) - SK) = ]T d(M) M J] hi(M), 

where Dm is the set of indices i such that rrii(M) > and 



(5.16) 



n(n — 1) 



n=2 



(5.17) 
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Since hi(M) = if m,i{M) = 1, we may restrict the sum in (15.161) to mono- 
mials M for which rrii(M) > 2 for i G Dm- 

We obtain a graphical representation for ( 15.161) by associating to each 
monomial M a graph Gm'-, Gm has a vertex for each factor in M, and 
vertices corresponding to factors t B ,tc are joined by an edge if and only if 
B n C ^ 0. We will show in Appendix B that d(M) = unless G M is 
connected; from this observation together with the remarks above it follows 
that the sum in ( 15.161) can be restricted to the set Ai of all monomials for 
which mi(M) > 2 for all i G Dm and for which Gm is connected. We 
also show in Appendix B that if Gm is a cycle with k > 3 vertices then 
d(M) = (— l) fc+1 . Note finally that if Gm consists of two vertices joined 
by an edge then the requirement that rrii(M) > 2 for i G Dm implies that 
M = t% for some B, so that c n (M) = 5 n ^ and d(M) = -1/2 from (15~T7D . 

6 Entropy for the SSEP 

We now apply the expansion (15.161) to the special case of the SSEP, taking 
/iA to be the NESS measure /2l on and thus to be the product measure 
vf \ which we will here write as vl- We will use ( 11.11) to identify the order, as 
L — > oo, of the terms in the series; we then show that in this limit the leading 
order terms in this series sum to R. We do not, however, give estimates which 
would completely justify the neglect of the higher order terms. 

Let us denote the order in L of a monomial M G M. by —Jm, that is, 
we suppose that M is 0(L _JM ) as L — > oo. From (II. ip we know that ts 
is of order L~(! jB '~ 1 ), so that if M has k factors (not necessarily distinct), 
M = t Bl ---t Bk , then j M = ^i=i(l-^«l — -Q- Since \B{\ > 2 for each /, 
k < (1/2) ^2 But then, because irti > 2 for i G Dm, 

/=i i=i 

note that \Dm\ is the total number of sites which belong to some Bi. Equality 
holds in (16. ip if and only if 

\Bi\ = 2 for each factor t Bl of M, and rrii(M) = 2 for each i G D M - (6.2) 

The terms satisfying condition (16.21) give the leading order contribution to 
S(P>l) — S^vl), as we now discuss. 

Let A4i C M. be the monomials for which 2m — \Dm\, that is, those 
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which satisfy (I6.2p . and let M. 2 — M.\M.\- Then we write (I5.16P in the form 

L 

S{ji L ) - S{v L ) = Y, E (sl,i(A) + s l , 2 (A)), (6.3) 

k=2 Ac{l,...,L} 
\A\=k 

where 

s Lj (A)= E d(M)M Yl hi(M), j = l,2, (6.4) 

MGMj i&D M 
D M =A 

so that when j = 1, each summand in (16.41) is of order L - '" 4 ', while when 
j = 2, each term is of higher order. 

We first consider the sum of the s Lt i(A). For M G Mi, 05.151) and (I6.2p 
imply that hi(M) = l/[tj(l — U)}. Moreover, (16.21) and the requirement that 
Gm be connected imply that Gm is a cycle or, if \Dm\ = 2, a single edge 
connecting two vertices, and for these graphs we know the value of d(M), as 
discussed at the end of section El This leads to 

where the sum is over all cyclic permutations a of A. Here the overall factor 
of 1/2 arises for \A\ = 2 from d(M) = —1/2 and for \A\ > 3 from the fact 
that the permutations from a cycle and from the reverse cycle give rise to 
the same monomial. Thus 

E 

\A\=k 



where Hi was defined in (14.41) and the 0(L l ) error arises from the fact that 
the sum omits terms in which some of the indices ij coincide. 
It follows from (IBTE]) . KW> and KT5\\ that for k > 2, 

L^oo 2k 
\A\=k 

It is also true that 

&Z E °*>M) = E -^k— TlHk = R (6 - 8) 

k=2 \A\=k k=2 
16 



("I) 



fe+1 



2 A; 



1) 



fc+i 



2k 



E (U L ) ili2 (U L )i 2 i 3 ■ ■ ■ (U L )i k _ lik (U L )i kil 

(6.6) 



■[Tr^ + O^- 1 )], 



(see (14.171) ); this will follow from (16 .7p and the Lebesgue dominated con- 



vergence theorem if we show that 



< ek for some conver- 



E\A\=k S L,l( A ) 

gent series X/fc e fc- Now since < for all i,j and hence the 0(L _1 ) 
term in (16.61) has the opposite sign to Tr H^, and since for any e > 0, 
\hi,{x, y)\ < \h(x,y)\ + e = \h(x,y) — e\ for sufficiently large L, we have 
from ( 14. lip that for such L, 



\A\=k 



1 

< 

~ 2k 



Tr# 



1 

< — 

~ 2k 



Ty(H - eCY 



(6.9) 



where C is the integral operator with kernel c(x,y) = 1. If we take e suffi- 
ciently small that \\H — eC\\ < 1 then ( 16.91) furnishes the needed bound. 

We now consider the contribution to (16. 4p of the terms sl^A), each of 
which is 0(L _J ) with j > \A\. Since there are order L k sets A with \A\ = k, 
we have formally that 

lim V s L o(A) = 0. (6.10) 



\A\=k 



We will assume that (I6.10p holds and can in fact be extended to 



lim £ S ^{A) = 0. 



k=2 \A\=k 

From (jO . (EHD, and (IfiTTT]) we have 

lim [^(/xl) - 5(z/ L )] = i?, 

which verifies ( 12.151) . 



L— >oo 



(6.11) 



(6.12) 



7 Conclusion 

In this paper we have seen how the truncated pair correlation function 
which describes the Gaussian fluctuations of the density profile in the non- 
equilibrium steady state of the simple exclusion process also determines the 
leading correction, which is of order 1, to the entropy S(fi). One could also 
ask how the higher order truncated correlation functions, which are related 
to higher order terms in the expansion of the LDF around p, contribute to 
further corrections to the entropy. Going beyond the simple exclusion process 
(and the WASEP and KMP model), in which local equilibrium corresponds 
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to a product measure, it would be interesting to consider more general non- 
equilibrium steady states in which, in addition to the weak long range part 
of the correlation of the form (1.1), there is an 0(1) short range part. The 
simplest extension of our result would be that the leading order term would 
again be given by that of the local equilibrium and that the leading correc- 
tion would again be that coming from the non local part of the truncated 
pair correlation. Another interesting extension would be to cases in which 
the leading order of the entropy is still obtained from a local equilibrium 
product measure but the long range part of the correlation obeys another 
scaling or in which the fluctuations of the density are not Gaussian (as in 
the asymmetric simple exclusion process; see |28j). 

For isolated systems at equilibrium, that is, in the microcanonical en- 
semble, all microscopic configurations have equal probability, and so S(fi) = 
— log/i = log|fi|, where \Q\ is the number of configurations, or the phase 
space volume, available to the system. When one moves to the canonical en- 
semble, still at equilibrium, the probabilities of configurations visited by the 
system fluctuate: the Gibbs-Shannon entropy S(p) is just the expectation 
of the logarithm of these probabilities. The variance of this logarithm is, up 
to a trivial temperature factor, the variance of the energy; it is an extensive 
quantity whose value per unit volume (or lattice site) V(p) is related to the 
specific heat. One expects further that, in equilibrium systems, the quantity 
[— log/i — S(p)]/ ^LV(p) will in the L — ► oo limit approach a standard nor- 
mal random variable; this is an exercise for one-dimensional systems in [29J. 
It is easily verified that the same holds for the local equilibrium measure t?l 
considered here. 

A natural question now is: in what respect is the distribution of this 
logarithm in nonequilibrium steady states, such as the NESS of the SSEP, 
different from or similar to the distribution in equilibrium systems? For 
example, are there characteristics of this distribution which can be related 
to physically measurable macroscopic quantities? 

Although we do not know yet whether such questions have general an- 
swers, we have measured for small system sizes the quantity V(pi): 



Our results are plotted in Figure 4 for p a = 1 and pb = 0; V(£Ll) appears 
to approach a fixed value in the large L limit. For comparison we have also 
plotted there the corresponding quantity V*(£Ll) defined by 
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Figure 4: Variances V{p,i) (solid line) and V*{Jx,l) (dashed line), evaluated 
for small systems for the SSEP with p a = 1 and p& = 0, plotted against 1/L. 
Equation (I7.3P predicts a large L convergence to 0.179956... 



In fact, by repeating the arguments of sections 5 and 6 one can show that 
the limiting values of these two quantities coincide and are given by 

jjmVfa) = f 1 dxF 1 (x)(l-F 1 (x)) (log Fl %] ) + 

L^oo J Q \ l-F x (x)J 

2j\ X j\y FAx , y) (log^y (^j^j) ■ (7.3) 

The first term in (17. 3ft is the corresponding quantity for the local equilibrium 

system: 

limV(u L ) = lim \/{-\ogu L (T L )-S{u L )} 2 ) 

= J X dxF x (x)(\ - F x {x)) {log i 2 • ( 7 - 4 ) 

The difference between (17. 3p and (17.41) shows that in contrast to the entropy 
itself, for which local equilibrium gives correctly the leading order in L [17] , 
the two point correlations affect the leading order of the variance LV(/2l)- 
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For p a = 1 and p = the expression (I7.3P takes the value n 2 /9 — 11/12 « 
0.179956, and the expression ([73]) the value (tt 2 - 6)/18 « 0.214978. 
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A Correlation functions in the SSEP 

Correlation functions in the SSEP may be obtained via the matrix method 
[I]. One introduces matrices D and E and vectors | V) and (W\ which satisfy 

DE-ED = D + E, (A.l) 
(f3D-5E)\V) = \V), (A.2) 
(WHaE-yD) = (W\ , (A.3) 

where a, (3, 7, and 5 were defined in section [21 Then 

- ( , (W\(nD + (1 - n)E) ■ ■ ■ (r L D + (1 - t l )E)\V) 

^(n,...,T L ) = (w\(D + ewv) ' (A ' 4) 

and so (in this section we write (-)p L = (-)l) 

{W\(D + E) il ~ 1 D(D + E) i2 ' il ' 1 D ■ ■ ■ D(D + E) L ~ ik \V) 
in, ■ ■ ■ r lk ) L - _______ . 

(A.5) 

The normalization factor in (1A.51) has been evaluated in [TO] : 

(W\(D + E) L \V) = r , T{ *M +L \ L (W\V). (A.6) 
T(a + b){p a - p b ) L 

Now one obtains a recursion relation for the correlation functions: starting 
from the formula (1A.5h for (r^ • • • T ik T ik+1 )L, one first commutes the rightmost 
factor of D to the extreme right in the product, using [D, D + E] = D + E, 
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then writes D\V) = {(3 + dy^V) + 5{D + E)\V)) (which is equivalent to 
IPO]) ); the result is 

, . (Pa-p fc )(L + fe-4 +1 ) 

' ' ■'ife'ifc+i/i _^ _|_ a _|_ ^ _ ]_ ' n ' ' l k)L-l 

+Pb(n 1 ---n h ) L . (A. 7) 

Taking = 0, 1, and 2 one recovers (12. 3p . (12. 4p . and (12. 5ft ; (1A.7I) may now 
be written in the form 

( T h ■ ■ ■ T i k T ik+1 ) L = ((r ik+1 ) L - Pb)(M r h ■~T ih )) L + (7i fc+1 >£(r< 1 ■ ■ ■ r lfc ) L , 

(A.8) 

where for any sequence 01,02,03, .. . we write 

(Ac) L = c L _x - C £, L > 2. (A.9) 

The truncated correlation functions tA,L = ( r n ' ' ' r « fe )L5 where A = 
{ii,..., with > 1, are defined recursively by 

(Tn---T ik ) L = Yl U tBL ( A ' 1Q ) 

(see (15.21) ). We claim that for k > 1 these functions satisfy the recursion 

«Au{W I x = «r <fc+1 ) £ -p 6 ) ^ 11^)^ ( A ' n ) 

which, together with = determines all the t^,L- We will verify 

(lA.lip below, after we have shown that it implies ( 11.11) . 



It follows from ( 1A.11I) that for A = {i\,...,ik}, tA,L = v l(£)> "where 
i = . . . , ij.) and v k (z) is a rational function of L and which is a 

polynomial of degree 1 in each of the ij. For x = (xi, . . . ,xj~) G M. k let us 
define u k L (x) = v\(Lx); u is again rational and a polynomial of degree 1 in 
each Xj, so that we will obtain ( 11 .ip if we show that u k L = 0(L~ k+1 ). We 
show this by induction on k; for k = 1 it is an immediate consequence of 
Q . But if u\ = 0(L~ k+1 ) for k < k then from 

(Av k ) L (Lx) = (Au k ) L (x) + [tt^Ql + (L - l)" 1 ]*) - «*_ x (s)] (A.12) 

it follows that (Av k ) L (Lx) = 0(L~ fc ) if k < k , and u\ = 0{L- k+1 ) for 
k = k follows by evaluating flA.110 at i = Lx. 

Remark A.l: The recursion ( 1A.11I) implies a similar recursion for the 
Ffc. Recall that the operator ^2^ =1 Xid/dxi acts on a monomial of degree 
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d in Xx, . . . , Xk as multiplication by d, so that the operator D k = k — 1 + 
Si=i Xid/dxi multiplies such a monomial by A; + d — 1. Then 

F k+1 (x 1 ,...,X k ,X k+1 ) = (Fifcfc+i) -p 6 ) J^[D|B|F|B|]((Xi) iG B). 

7re"P({l, ...,&}) BStt 

(A.13) 

This follows by writing = *- fc+a! 1 - ) -Pd + h.o.t., where Pd is homo- 

geneous of degree d in ii, . . . , i k and h.o.t. denotes terms which are 0(L~ k ) 
after the substitutions ij = Lxj, j = 1, . . . , L. We will not use this formula 
and so omit further details, but we do note that an easy consequence is that, 
for k > 2, F k depends on a, j3, 7, and S only through an overall factor of 

(Pa ~ Pb) k - 

Proof of the recursion (IA.11I) : To verify flA.lip we need a formula for the 
action of A on a product (see (IA.9I) ). Suppose that . . . , are sequences 
(i.e., cW = (c^)2 D =1 ) and that we multiply such sequences componentwise, 
so that (c^ ■ ■ ■ c^)l = ■ ■ ■ Then trivially 

(1 + A)(c (1) • • ■ c ik) ) = [(1 + A)c«] •••[(! + A)c (fc) ], (A.14) 

and so with X = {1, 2, ... , k}, 

a( C w... c w)= ri Ac(i) n ° u) - ( a - is ) 

®^YcXieY jex\Y 

For example, 

A(c^c^) = Ac^c^+c^Ac^+Ac^Ac^, (A.16) 

+Ac^Ac^c^ + Ac^c^Ac® + c^Ac^Ac® 
+Ac«Ac< 2 >Ac< 3 >. (A.17) 

We now verify (1A.11I) ; the case k — 1 is precisely (1A.8I) for k — 1, and we 
proceed by induction on fc. We use (1A.10I) to write (r^ ■ • ■ T ik T ik+1 ) the left 
hand side of flA.8j) . in terms of truncated correlations, separating the terms 
in which i k +i is grouped with some element of a partition of A from those in 
which {ik+i} is an element of the partition of A U {ik+i}'- 

Y S ^2 t Bu{t k+1 },L \\ t c ,L + t{ ik+1 },L II ti3L (A.18) 

neV(A) B&i Cen neV{A) Ben 

C+B 

On the other hand, with (lA.lOp the right hand side of f]A.8|) becomes 

neV(A) Ben neP(A) Ben 
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Since (IA.18I) and flA.19[) are the two sides of (IA.8I) we may equate these 
expressions to obtain 

E Ew^w II tc,L = ((n h+1 ) L -p b ) E ( A U tB ^- ( A - 2 °) 

neV(A) Ben Cen neV(A) Ben 

C^B 

On the right hand side of (IA.20I) we use (j A. 15ft to write 

e ( A n*^= e e n( A ^ n to*. (A.21) 

neV(A) Ben neV{A) ®^oCn Cea Cen\a 

On the left side of ( 1A.20I) the term with tc = {A} is just tAu{i k+1 },L', we take 
the remaining terms to the other side of the equation and in these terms use 
the induction assumption to write 

tBu {lk+1 },L = ((r lk+1 ) L -p b ) E II( A ^- (A.22) 

aeV(B) ceo- 

After these manipulations, ( 1A.20I) becomes 

tAu{i k+1 }, L = ((r ik+1 )L-Pb)[ e e n tc > L 

neV(A) 0^0-ctt Ceo- cen\a 

- E E e n^^nH- (A - 23) 

weV(A) Ben aeV(B) C£a Cen 
n^{A} C^B 

We now reorganize this expression. In the first sum we separate the term 
tc = {A}, which is simply (A£a)l (since necessarily a = {A} also); in the 
remaining terms of this sum we relabel tc as tc', with ir' ^ {A}. Now every 
term in the second sum is labeled by a partition tc, a distinguished set B 6 tc, 
and a further partition a of B; this data clearly gives rise to a new partition 
tc' of A, 7r' = (-7T U c) \ {-B}, and a distinguished subset cr of tc'; note that 
o~ ^ since cr is a partition of B and a ^ tc' since 7r 7^ {A} and hence | vr j > 2. 
Thus 
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tAu{i k+1 },L = ((n k+1 )L ~ Pb) [(A£a)l 

+ e ( e n<*°>i n 

Tr'e-P(A) 0^crC7r' Cea Cen'\a 

- e ri( A ^)^ n ^)\ ( a - 24 ) 

B^ctCtt' Cea Cen'\a 

In the sum over tc' only the terms with o = tc' survive, leading to OA-llO : 

tAU{i k+1 },L=((Ti k+1 )L-pb) E II^*^- ( A ' 25 ) 

n'eV{A) Ben' 
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B The coefficients d(M) 



In this appendix we derive the two properties of the combinatorial factors 
d(M) (see (15.171) ) which are needed in section [6j that d(M) = if Gm is 
not connected, and that d(M) = (— l) fc+1 if Gm is a cycle on k vertices. 
Our approach is to relate d(M) to the number of colorings of the graph Gm- 
The condition that only monomials M for which rrii(M) > 2 for all i G Dm 
occur in (15.161) implies that every component of Gm contains at least two 
vertices, and we assume that all graphs considered in what follows satisfy 
this condition. 

For any graph G we let c n (G) be the number of n-colorings of G, where an 
n-coloring of G is an assignment of colors to the vertices of G, using exactly 
n colors, in such a way that adjacent vertices are given distinct colors. For 
example, if G is a cycle on four vertices then c±(G) = 24, 03(G) = 12, and 
02(G) = 2. Note that the condition that every component of G have at least 
two vertices implies that c%(G) = 0. We also define 

^ = E^^TtMG). (B.l) 

n=2 V ' 

Suppose now that M is a monomial occurring in (15.161) . say M = Y[ B t k B B 
with the t B distinct; the graph Gm has k B vertices, and we will denote 
the k B vertices corresponding to B by v B> i, ■ ■ ■ , ^B,k B - Recall that c n (M) 
is the number of n-tuples 7r = (tti, . . . , ir n ), with 7Tj G V(Dm), such that 
M = YYj=i YlceTr An n-coloring of Gm immediately yields such a n, 
by taking 7Tj to be the set of all B such that some vbj is assigned color i. 
Each 7r arises in this way from Hb^s' distinct colorings, since for each B 
we may permute the colors assigned to the vbj without changing n. Thus 
c n (G M ) = c n (M) Y\ B k B \, and 

d(G M ) = d(M)\[k B \. (B.2) 

B 

We next derive a recursion relation for d(G). We first select some vertex 
v of G, and let N v be the set of vertices of G which are adjacent to v. Every 
n-coloring of G induces a partition A of iV^,, where two vertices are in the 
same set of the partition iff they have the same color; note that vertices in N v 
which are adjacent cannot lie in the same element of A. Conversely, given any 
partition A of N v satisfying this latter restriction we define the graph G\ by 
(i) removing from G the vertex v and all edges adjacent to it, (ii) collapsing 
all vertices belonging to a single subset B G A into a single vertex w B in 
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G\ (which may give a multi-graph; if so, we replace any multiple edges by 
a single edge), and (hi) joining each pair wb,wb' of new vertices produced 
in this way by an edge. Then every n-coloring of G is obtained by choosing 
A and then either (a) choosing one of the n colors to assign to v and using 
the remaining colors for some (n — l)-coloring of G\, or (b) choosing an n- 
coloring of G\, then choosing one of the n — |A| colors not used on the new 
vertices % to assign to v. This leads to the recursion 

c n (G) = Y^[nc n -i{G x ) + (n - |A|)c n (G A )]. (B.3) 

A 

Then if no G\ is 1-colorable, so that c n -i{G\) — if n = 2, 



n(n — 1; 

n=2 v ' 



1 



\n+l 



A n=2 v JK ' 



n=2 



(-1, 

n(n — 1) 



(n - 2)c n -. 1 (G x ) 
(n-\\\)c n (G x ) 



A rt=2 ^ ' 

5^(1 - |A|)J(G A ). (B.4) 



This is the desired recursion. 

As a first consequence of (1B.4|) we show that if G is a disconnected graph 



in which every component has at least two vertices, then d(G) = 0. We argue 
by induction on the number n of vertices of G; certainly n > 4. If n = 4 
then G has two components, each a single edge joining two vertices, and an 
application of ( IB. 41) shows that d(G) = (there will be only one partition 
A, with |A| = 1, in the sum). We now argue by induction on n; if we apply 
( IB.4p with any vertex v of G, every d(G\) on the right hand side will vanish 
by the induction assumption unless the "new" component of G\ has a single 
vertex, in which case |A| = 1; thus d(G) = 0. 

As a second application we compute d(G) for G a cycle. First note that 
if G is a graph with 2 vertices joined by an edge then d(G) = —1, by a 
simple direct calculation. If G is a cycle with k > 3 vertices and v is any 
vertex of G then N v contains two vertices, say N v = {11)1,11)2}, and the sum 
in ( 1B.4I) has one term A = Aq = {{^i}, {u^}} and, if k > 4 so that w\ and W2 
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are not adjacent, also one with A = {N v }. The latter term, even if present, 
does not contribute since |A| = 1, so d(G) = —d(G\ ). But G\ is a cycle 
with k — 1 vertices or, if k = 3, the two-vertex graph considered above; thus 
d(G) = (— l) fc+1 by induction on k. 
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